
ntoottiutri potter mnintt 



Policy Report 

April 2005 



Lifting Teacher Performance 

By Andrew Leigh and Sara Mead 

R esearch increasingly demonstrates what common sense has long made 
apparent to educators and parents:Teacher quality matters— a lot. Teachers' 
knowledge and skills are the most vital in-school factors influencing children's 
learning. And, for children from disadvantaged backgrounds or troubled home 
environments, quality teaching is even more important. 



Unfortunately, the quality of America's 
public school teaching force is neither as good 
as it could be nor as good as it must be to prepare 
our children for a global economy. Certainly, 
the nation has thousands of highly skilled, 
dedicated teachers. But, since the 1960s, the 
quality of the teaching profession has declined. 
Even more troubling, there are huge teacher 
quality disparities between poor and affluent 
schools. Disadvantaged children— those who 
most need excellent teachers— are the least 
likely to have them. 

It is time for policymakers to realize that 
the status quo methods of improving teacher 
quality simply do not work. Many of the old 
solutions favored by education groups to 
improve teacher quality— such as raising teacher 
salaries across the board, improving training, and 
requiring certification— have not fixed the 
problem. Indeed, one of the most popular 
education policy proposals of recent years, 
cutting class sizes, risks unintentionally lowering 
teacher quality even further, as affluent districts 
make up their numbers by poaching the most 
capable teachers from poorer areas. 

T he tro uble is that these status quo so lutio ns 
do not focus on the real problem driving 



declines in teacher quality: an outdated 
preparation and compensation scheme that 
demands and rewards the wrong things, and that 
provides too few growth opportunities to attract 
highly skilled individuals to teaching in sufficient 
numbers. W ithout bottom-up reform of the 
fundamental assumptionsofourcurrentteacher 
preparation and compensation regimes, neither 
the old policies, nor the promises of the No 
C hild Left Behind Act (N C LB) to place a highly 
qualified teacher in every classroom, can have 
much success. 

There isa better way. Policymakers can draw 
on the latest performance data and research to 
craft effective policies that reward and attract 
highly skilled teachers. Regular testing, as 
mandated by NCLB, allows researchers and 
policymakers to track student achievement over 
time and link results to teachers. By measuring 
test score gains from one year to the next, 
researchers and administrators can better 
determine the characteristics and conditio ns that 
lead to effective teaching. That will allow 
policymakers to reward teachers who do a 
better job in the classroom, taking into account 
the composition of their student body. In addition, 
a new stream of labor market research provides 
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insight into how and why individuals decide to 
enter or leave the teaching profession and where 
they choose to teach. 

This paper analyzes promising new 
research about teacher quality and the 
incentives for teachers to do better. W e assess 
current teacher quality approaches and offer 
recommendations to help policymakers 
modernize how teachers are prepared, hired, 
evaluated, and compensated. Among the most 
promising solutions are: 

□ C arefully designing systems of performance- 
based teacher pay; 

□ Rewarding teachers who choose to work 
in the schools that need them most; and 



□ Streamlining or expediting certification 
requirements to expand the pool of 
individuals who can be hired as teachers. 

While the research evidence for 
modernizing teacher preparation and 
certification is clear, the politics are more 
challenging. Established interests with a stake in 
the status quo arrangements of educating, paying, 
and assigning teachers oppose reforms that 
interfere with their established prerogatives. But 
unless policymakers are willing to tackle these 
tough politics, we will continue to condemn 
millions of disadvantaged children to an 
inadequate education and run the risk of 
undermining our nation's future economic 
competitiveness. 
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What Is Quality Teaching? 

Researchers, policymakers, parents, and even 
teachers themselves agree that teacher quality 
matters. But defining, measuring, and identifying 
teacher quality is a far more controversial task. 
In an education environment focused on 
improving student achievement, the ultimate 
measure of teacher quality is the impact the 
teacher has on student learning. Yet, how can 
we measure teacher performance and ensure 
recognition for the best performers? 

In assessing teacher performance, the main 
problem is separating out the components of 
student performance that are due to a child's 
background and non-school experiences from 
those that are due to teaching quality. If we 
observe a class in which children have high test 
scores, it could either indicate that they have a 
terrific teacher or that the student body is 
particularly gifted. Similarly, if we see a low- 
scoring class, it could be that the teacher is 
underperforming, or that a large fraction of the 
students already have educational deficits or 
learning difficulties when they enter the 
classroom. 

A crude means of separating student and 
teacher effects is to break down average scores 
by categories. The N C LB requires schools, 
districts, and states to report not only average 
test scores, but also disaggregated data for 
different racial categories, disadvantaged 



students, English language learners, and students 
with disabilities. But this only controls for a few 
observable differences. Given that motivation, 
parental resources, and previous education 
experiences vary within categories, basic 
breakdowns— while important for equity and 
transparency purposes— are of limited use in 
measuring the effectiveness of individual 
teachers. 

A more precise solution is not simply to look 
at test scores in a single year, but to follow the 
changes in students' scores from one test to the 
next. In this way, we are able to measure the 
value added by teachers. Work by William 
Sanders, the developer of the Tennessee Value- 
Added Assessment System, has shown that a 
value-added methodology can be applied in a 
simple and straightforward manner. Colorado 
and Tennessee are two of the states that use 
such methods to calculate the value added by 
individual teachers . 1 Observing student 
performance across multiple years allows us to 
separate teacher effectiveness from innate 
student characteristics as well as systemic 
differences between schools (such as principal 
quality or infrastructure). 

How BigAre Differences 
Between Teachers? 

A common assumption made by education 
groups is that all teachers are pretty much the 



Comparing Teacher Quality Reforms and Class Size Reduction 



Reform 


Effect on students' test scores 

(in standard deviations) 


Effect on students at 
the 50th percentile* 


Switching from an average teacher to 
a teacher at the 90th percentile 


+0.12 


55th percentile 


Reducing class size from 24 to 22 
students (high-end estimate) 


+0.06 


52nd percentile 



*This assumes that both teacher effects and student test scores are normally distributed. 
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same.W hat matters, according to this view, is 
helping each teacher perfo rm to the best of their 
ability. Unfortunately, this assumption is not 
supported by the evidence. Research by Steven 
Rivkin, Eric H anushek, and John Kain (using data 
from Texas), and by Jonah Rockoff (using data 
from N ew Jersey) have found large gaps between 
the best and worst teachers, and shown that this 
variation has significant consequences for student 
achievement. 2 Switching from an average teacher 
to a teacher at the 90th percentile raises test 
scores by about one-eighth of a standard 
deviation on the national distribution. To put 
this into perspective, the benefit from this switch 
is twice as large as a 10 percent cut in class size 
(and some studies suggest that class size cuts 
have even smaller benefits than this). 3 

N ote that the table on page 3 assumes that 
a student already has a mid-range teacher. Of 
course, the potential gains can be even larger 
for those students who currently have below- 
average teachers. A student who swapsateacher 
at the 10th percentile for a teacher at the 90th 
percentile, for example, would be expected to 
move their test scores up from the 50th 
percentile to the 60th percentile. 

To further put these differences into 
perspective, we can consider how improved 
teacher quality might affect the large and 
troubling achievement gap 
between white and black 
students. O n average, black 
12th graders score at about 
the same level as w hite eighth 
graders on the N ational 
Assessment of Education 
Progress— a difference 
roughly equivalent to one 
standard deviation. 4 Re- 
search on teacher quality 
suggests that it is possible to 
close these gaps. If the effects 
of high-quality teachers persist over time, that 
would mean moving a black student from the 
classroom of a 10th percentile teacher to a 90th 



percentile teacher for four years would close 
the black-white test score gap. O n a macro level, 
this suggests that policymakers must not simply 
equalize teacher quality between high-poverty, 
high-minority schools and more affluent schools, 
but also must make a concerted effort to attract 
the most skilled teachers to these hard-to-staff 
schools. Unfortunately, current teacher training, 
compensation, and assignment policies work as 
if they had been designed to do just the o pposite. 
Union work rules have established uniform 
district-level teacher pay scales. Teachers are 
not rew arded fo r their perfo rmance, o r the level 
of challenge in a teaching assignment, so they 
naturally seek jobs with the best working 
conditions— namely, those in high-performing 
suburban schools. 

Characteristics Linked to 
Teacher Quality 

While impact on student achievement is 
clearly the most important criteria for evaluating 
teacher quality, research has also identified a 
number of directly observable teacher 
characteristics that are linked to teacher quality 
and performance. 

The most compelling, consistent body of re- 
search shows that a teacher's verbal or intellec- 
tual aptitude correlates with 
better student achievement 
results. For example, Ronald 
Ehrenberg and Dominic 
Brewer observed higher test 
scores for students whose 
teachers attended selective 
undergraduate colleges. In ad- 
dition, Ronald Ferguson and 
H elen Ladd found that 
teacher scores on licensure 
and aptitude exams were posi- 
tively correlated with better 
student outcomes (thoughts we discuss below, 
having to take these exams deters some poten- 
tial teachers from entering the profession). 5 



Policymakers must not 
simply equalize teacher 
quality between poor 
and affluent schools, but 
also must make an 
effort to attract the 
most skilled teachers to 
needy schools." 
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It may seem obvious that the most 
academically talented teachers are the best 
teachers. But it is important to note that the 
evidence for the importance of teacher aptitude 
is far more compelling and clear than any 
existing evidence about teacher training. In other 
words, current research suggests that, absent any 
other information about the individuals involved, 
we would be wiser to bet on the teaching 
success of an individual with strong verbal and 
intellectual skills, or high test scores and no 
teacher training, than we would be to bet on 
the success of someone with mediocre skills 
and full teaching certification. Clearly, at the 
individual level, other personal factors are 
critical, but working with limited information, 
research provides the strongest evidence for the 
importance of teachers' intellectual and verbal 
skills. 

Research also shows that teacher 
knowledge of specific subject matter, 
particularly at the secondary level, is a good 
predictor ofstudent achievement. David Monk 
finds a strong correlation between teacher 
subject matter preparation in math and 
physical sciences and student success fo r both 
low and high-scoring students, while Daniel 
Goldhaber and Dominic Brewer note that 
students do better in math if taught by a 
teacher with a bachelor's or master's degree 
in mathematics . 6 In addition, limited evidence 
suggests that training in pedagogy, particularly 
methods of teaching in the subject area, 
improves teacher quality . 7 W hile it may seem 
obvious, these findings run counter to decades 
of state teacher certification policies that put 
far more emphasis on teachers' completion 
of teacher education coursework than 
mastery of academic content in their fields. 
Although states are beginning to shift this 
balance— and N C LB's highly qualified teacher 
provisions place emphasis on content 
knowledge— the continued prevalence of 
assigning teachers to subjects for which they 
have no training, known as "out-of-field" 



teaching, as well as state efforts to subvert 
NCLB's content requirements for current 
teachers, suggestsA merica's public school system 
has not yet internalized this commonsense 
finding. 

W hile impact on student achievement is the 
most important measure of teacher quality, the 
relation of these 
traits to student 
performance is 
also important 
for policymakers 
to keep in mind 
when crafting 
policies to boost 
teacher quality. 

Policymakers 
cannot evaluate 
the performance 
of prospective teachers before they enter the 
classroom. So state legislation and regulations 
for teacher preparation, certification, and 
licensure seek to control teacher quality by 
requiring individuals who want to teach to 
have completed certain educational 
requirements and tests. Unfortunately, held 
against the evidence of what makes for 
effective teachers, most state systems seem 
to be measuring the wrong things, focusing 
too heavily on teacher preparation 
coursework for which there is little evidence, 
and too little on ensuring that teachers 
demonstrate high verbal skill, intellectual 
ability, and a stro ng grasp of their co ntent area. 
By reforming teacher certification legislation 
to reflect research evidence about teacher 
quality, policymakers can more effectively 
encourage individuals with traits linked to 
teacher effectiveness to become teachers. 

Is There a Teacher 
Quality Problem? 

Is there a teacher quality problem in 
America's public schoolstoday, or are teachers 



“The evidence for the 
importance of teacher 
aptitude is far more 
compelling and clear 
than any existing 
evidence about 
teacher training." 
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simply the scapegoat for declining families and 
communities, inequitable school resources, and 
a host of issues beyond their control that depress 
student achievement? Below, we assess the 
evidence, and conclude that teacher quality has 
indeed declined. If this were not troubling 
enough, a second stream of research shows that 
the problem is most acute in schools serving 
high proportions of minority and low-income 
students. Since N C LB enjoins policymakers to 
address both overall teacher quality and the 
distribution of good teachers across schools, this 
is troubling indeed. Realizing an equitable 
teacher distribution for poor and minority 
students will require a broader rethinking and 
reform of state policies about how we train, pay, 
assign, and evaluate teachers. 

Teacher Aptitude Has Declined 

Recent studies provide evidence of a 
sharp decline in teacher quality since the 
1960s. Sean Corcoran, W illiam Evans, and 
Robert Schwab combine data from four 
longitudinal surveys, spanningthe early 1960s 
to the mid-1980s, and find that the percentage 
of teachers who placed in the top 20 percent 
on national achievement tests fell markedly 
during this era. 8 Marigee Bacolod uses data 
from the National Longitudinal Surveys of 
Youth, observing substantial differences 
between the test scores of teachers who 
graduated college between 1962 and 1966 and 
from 1984 to 1985. 9 Analyzing the results of 
standardized tests administered to both 
cohorts, she found that one-half the female 
teachers graduating in 1962 to 1966 scored 
above the 80th percentile, while only 10 
percent did so if they graduated between 
1984 and 1985. Among male teachers, the 
fraction scoring above the 80th percentile fell 
from 20 percent to 10 percent. These findings 
suggest that the intellectual aptitude of 
teachers fell relative to other professions 
during this time. 



Further evidence on teacher quality may 
be found in the mean standardized test scores 
of college-goers who report that they intend to 
major in education. From 1970 to 1975, the 
composite ACT score of the average woman 
intending to major in education dropped from 
10 percent above the female mean to 2 percent 
below the female mean (and has stayed below 
the female mean ever since). During the same 
period, the ACT score for the average man 
intending to major in education dropped from 
5 percent to 12 percent below the male mean. 10 

What Are the Causes? 

W hat might have caused the decline in 
teacher quality? Since we know that most of 
the drop occurred in the late 1960s and early 
1970s, we need to look for factors that 
changed in this period. Could average teacher 
wages be to blame? This seems unlikely. From 
the mid-1960s to the mid-1970s, inflation- 
adjusted wages for the average teacher rose 
substantially, staying ahead of the average 
wages for all college graduates. 11 Although the 
1990s saw the average wages of teachers 
converge to about the same as the average 
wage for all college graduates, this is well after 
the main drop in teacher quality took place. 12 

It also seems unlikely that teacher 
working conditions declined during this 
period. In fact, one important measure of 
teaching conditions— class size— fell 
dramatically during the 1970s (and continued 
to fall through the 1980s and 1990s). ^Violent 
crime by youth rose in the late 1980s and early 
1990s (before falling sharply through the 
present day). But in the 1970s, when teacher 
quality declined most, violent crime was 
relatively stable. 14 

So, why did teacher quality decline in the 
late 1960s and early 1970s, even as salaries 
rose? Research supports two explanations. 
First, expanded professional opportunities and 
more competitive salaries for women may 
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have pulled highly skilled women out of teaching 
and into other occupations, such as medicine or 
law. Second, collective bargaining agreements 
that compressed teacher pay scales and 
eliminated the possibility of performance- based 
pay for highly effective teachers might have 
reduced the returns to aptitude in teaching. Both 
of these push and pull effects occurred in the 
late 1960s and early 1970s, so either could 
potentially have been responsible. 

W hy might highly skilled women have 
been drawn away from teaching? For the first 
half of the twentieth century, teaching was one 
of the few professional occupations open to 
women, and as a result, talented, well-educated 
women gravitated toward teaching positions. 
As the women's movement of the 1960s and 
1970s opened professional job opportunities 
for women and more fields began to pay 
women salaries commensurate with those of 
their male colleagues, many highly able 
women left the classroom to pursue 
professional careers where they could earn 
better salaries. If the gender pay gaps narrowed 
more for high-skill professions (such as 
lawyers) than for jobs requiring medium skills 
(such as bookkeeping), then this would have 
disproportionately drawn the best women out 
of teaching, FI owever, it is important to note 
that this hypothesis requires different changes 
in pay gaps for high- and low-skilled 
professions. If all professions reduced their 
gender pay gaps at about the same rate, then 
this will not have the same adverse impact on 
teacher quality. 

It is perhaps easier to understand why 
expanded professional opportunities for 
women might have a negative impact on overall 
teacher quality than it is to understand how 
unionization affected teacher quality. After all, 
unions work to secure higher salaries for 
employees, which we would expect to raise 
quality. The key factor here, however, is not how 
collective bargaining impacted teacher salaries 
on average, but rather how it impacted the 



distribution of teacher pay, and, in particular, the 
earnings potential of the most talented teachers. 
In many professions and trades there is a "skill 
premium." Individuals who produce particularly 
good work or results also command higher pay 
for their labors, and salaries are widely dispersed, 
reflecting variations in talent and effort among 
different workers. Collective bargaining, 
however, condenses the range of potential 
salaries. 

During the late 1960s and early 1970s, the 
teaching profession was essentially unionized. 
U nio nizatio n 
compresses pay 
dramatically, so 
that all teachers at 
a certain level of 
education and ex- 
perience earn the 
same salary, re- 
gardless of how 
well they perform 
on the job. As a 
result, less skilled 
teachers tend to 
earn more than they otherwise would, while 
higher skilled teachers earn less. For example, 
in the early 1960s, a female teacher who 
attended a highly selective college received 
about a 59 percent pay premium. In 2000, a 
female teacher who attended a college in the 
top 5 percent received essentially no pay 
premium. If unionization caused the skill 
premium to fall, this could have forced out 
higher-skilled teachers, who have the best 
opportunities to earn rewards commensurate 
with their abilities. 

To separate the effect of changing gender 
pay gaps from the effect of pay compression, 
Caroline H oxby and Andrew Leigh measure 
ability by using the average SAT score of the 
colleges teachers attended. They look only at 
females, who have comprised about three- 
quarters of public school teachers during recent 
decades. Using variation within states over time, 



"Policymakers must 
modernize teacher 
compensation systems 
to reward excellence 
and difficult placements, 
so that teaching is 
competitive with other 
professional careers." 
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they find that about one-quarter of the decline 
in female teacher quality is due to changes in 
pay discrimination for women, while about three- 
quarters is due to wage compression driven by 
unionization. 

Pay compression and the feminization of 
other professions, it seems, are the main causes 
of the decline in teacher quality. Yet 
understanding the factors that caused teacher 
quality to decline does not necessarily lead to a 
solution to the teacher quality problem. For 
example, while gender pay gaps in other 
professions during the 1950s may have pushed 
many talented women into teaching, no one 
would argue for reinstating gender pay 
discrimination against women as a means of 
improving teacher quality. Instead, policymakers 
must modernize teacher compensation systems 
to reward excellence and difficult placements, 
so that teaching offers salaries and opportunities 
that are competitive with other professional 
careers for high-aptitude men and women. 

Poor Schools, Poor Teachers 

Before turning to possible solutions, it is 
necessary to discuss another aspect of teacher 

quality: the 

skewed distribu- 
tion of talented 
teachers across 
schools. While 
average teacher 
quality may have 
declined, there 
are still many ex- 
cellent teachers 
in classrooms acrossAmerica, but research also 
makes abundantly clear that skilled teachers are 
not evenly distributed across the student popu- 
lations. Children in high-poverty and high-mi- 
nority schools are twice as likely to be taught 
by inexperienced or uncertified teachers, and 
also more likely to be taught by teachers who 
scored poorly on college entrance exams. 15 



Snapshots from urban school districts 
around the country show that a disturbing 
number of teachers in disadvantaged schools lack 
subject area or teacher training. A 2001 
evaluation in Houston found that 35 percent of 
newly hired teachers (excluding those in the 
Teach for America program) did not even have 
a bachelor's degree. 16 State teacher quality 
reports federally mandated by Title II of the 
Higher Education Act also reflect significant 
disparities. For example, California reports that 
14 percent of teachers in high-poverty schools 
are not fully certified, co mpared to only 8 percent 
in other school districts. Texas and Louisiana 
report that 14 percent and 19 percent, 
respectively, of teachers in high-poverty schools 
are not fully certified, and the vast majority do 
not have subject matter expertise. Although 
many state reports minimize the extent to 
which teachers lack qualifications, 17 similar 
discrepancies between high- and low-poverty 
schools emerge across the country. 18 

Poor and minority students are also much 
more likely to be taught by teachers who lack 
training in the subjects they teach. Data from 
the National Center for Education Statistics' 
Schools and Staffing Survey shows that roughly 
one-third of classes in high-poverty and high- 
minority secondary schools are taught by 
teachers who lack even a minor in the subject, 
and classes in high-poverty schools are 77 
percent more likely be taught by teachers 
without subject matter training than those in 
low-poverty schools. 19 

N ot only do high- poverty, ethnically diverse 
schools tend to have teachers with low 
qualifications, they also have fewer teacherswho 
are true standouts. N ational Board C ertification 
is a widely recognized credential of teacher 
excellence that preliminary studies have linked 
to improved student achievement. But studies 
from the Urban Institute and SRI International 
show that, in states with the highest 
concentrations of National Board Certified 
Teachers (NBCTs), these teachers are 



“Classes in high-poverty 
schools are 77 percent 
more likely be taught by 
teachers without subject 
matter training than those 
in low-poverty schools." 
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underrepresented in high-poverty, high-minority, 
and low-performing schools, and more likely to 
be in schools with fewer poor or minority 
students. 20 (The one exception to this is 
California, which we discuss below.) 

High-poverty, high-minority schools often 
serve as training grounds for new and 
inexperienced teachers who, after getting more 
experience and training under their belts, move 
on to more affluent communities where 
students are less challenging to work with, 
salaries are often higher, and community and 
classroom demographics are more similar to the 
teachers' own backgrounds. 21 We know from 
research that teachers in their first year tend to 
be significantly less effective, so poor schools 
suffer when they act as a training ground for new 
recruits. 

Getting the best teachers into the 
toughest schools can sometimes seem like a 
Sisyphean task. W hile policymakers know that 
this is a vital way to provide real equality of 
opportunity, rich suburban districts often can 
offer more money and better conditions. But 
labor market research shows that more 
subtle factors, such as location, also play an 
important role. Researchers using data from 
N ewYork state found that 61 percent of new 
teachers started teaching in schools within 15 
miles of the district where they graduated 
high school. 22 This puts disadvantaged 
communities at a loss in recruiting teachers. 
Similarly, research on teacher mobility shows 
that many teachers change jobs in part to 
shorten their commute to work. This often 
means that the best teachers move away from 
disadvantaged urban schools to more affluent 
and less ethnically diverse suburban schoo Is. 23 

School organization, budgeting, and 
collective bargaining also perpetuate 
distributional inequities. Seniority-based 
collective bargaining provisions base teacher 
pay on experience, taking no account of which 
school they teach in, and also allow senior 
teachers to choose placements in less 



challenging schools, rather than letting 
administrators assign them where their skills are 
most needed. Paul Hill and Marguerite Roza 
have shown that this results in inequities 
between rich and poor schools, both in terms 
of teacher quality and resources. 24 Richard 
Ingersoll has also documented that high rates of 
out-of-field teaching tend to be more the result 
of school organization and administrative 
convenience than actual shortages of qualified 
teachers in certain fields. 25 

The Old Solutions Do Not 
Work and May Even Make 
Things Worse 

Across-the-Board Class Size 
Reductions Can Also Lower 
Teacher Quality 

In recent decades, the most expensive 
education reform has been cutting class sizes. 
Since 1970, student-teacher ratios have fallen 
from 22.4 pupils per teacher to 16 pupils per 
teacher today. A major class size cut in 
C alifornia in 1996 came at a cost of more than 
$1 billion per year. Yet the evidence on class 
size suggests the benefits are small, with some 
studies finding that smaller classes have no 
effect on student performance, while others 
show an effect that is positive, but small 
relative to gains in teacher quality (see the 
table on page 3). 26 

W hile smaller classes are popular with par- 
ents, teachers, and politicians, they can have 
an unintended detrimental effect on teacher 
quality. Across-the-board class size reductions 
force school districts to rapidly find new 
teachers. For example, when California enacted 
its class size reduction measure in the 1990s, it 
found itself short by so me 26,000 teachers. Re- 
searchers with the Class Size Reduction Con- 
so rtium fo und that, as a result, the percentage of 
not-fully-certified teachers in elementary schools 
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rose from 1.8 percent in 1995-1996 to 13.3 per- 
cent in 2000-2001. W hile the increase in 

uncredentialed 
teachers ap- 
peared to level 
off after 2001, it 
did not decline, 
and schools with 
more than 30 
percent low-in- 
come students 
employed the 
most uncertified 
teachers. 27 In 
another study of 
C al ifo r n i a's 
class-size reduction, Christopher Jepsen and 
Steven Rivkin found that more affluent schools 
tended to poach the best teachers from those 
serving poorer or minority schools. In one 
example, Jepsen and Rivkin concluded that, 
"high percentage black and high percentage low 
income schools in L.A. U nified suffered large de- 
clines in mathematics achievement in response 
to [the class size reduction program]." 28 They 
argue that rather than cutting class sizes 
across the board, policymakers should target 
any class size cuts on schools serving disad- 
vantaged populations, rather than implement- 
ing a one-size-fits-all policy. 

Teacher Certification Is Not a 
Silver Bullet 

State teacher certification mandates are 
highlytouted asa way of ensuringteacher quality, 
and policymakers often propose increasing 
requirements for prospective teachers to 
improve the quality of the teaching force. Today, 
all 50 states require teachers to obtain some 
form of certification or licensure. From the 1970s 
through the 1990s, many states instituted or 
increased mandatory teacher competency tests 
in response to concerns about teacher quality. 
Many have also increased teacher training and 



student teaching requirements. 29 Yet research 
suggests this approach may be counter- 
productive. 

First, there is limited evidence that the 
coursework, testing, and student teaching 
requirements that states demand for teacher 
certification ensure teacher quality. Research 
shows that teachers who possess higher levels 
of verbal aptitude, intellectual ability, and 
knowledge in the content area they teach are 
more effective than those who do not. But 
this research does not evaluate the value of 
specific requirements for teacher certification 
applied in different states. According to an 
analysisofthe body of research conducted by 
Michael Allen for the Education Commission 
of the States, existing research is not 
sufficiently detailed to reach beyond general 
conclusions or give policymakers specific 
guidance on the level of content knowledge, 
pedagogy, or test scores teachers need to be 
effective. 30 

There is even less evidence about 
certification itself, since state requirements that 
teachers be certified leave little opportunity to 
compare student results for certified versus 
uncertified teachers. Of the limited number of 
studies comparing student achievement impacts 
of teacher certification, many are plagued by 
methodological flaws, and the remainder offer, 
at best, conflicting findings. 31 For example, Dan 
Goldhaber and Dominic Brewer found that 
teacher coursework or certification in math or 
science had a positive impact on student math 
and science achievement, but they found no 
difference in student outcomes between certified 
teachers and emergency certified teachers 
(those who had not yet completed all the 
education requirements for teacher certification 
before taking a teaching job). 32 

O n the other hand, there is substantial 
evidence that certification barriers prevent some 
individuals from entering the profession. 
O btaining teacher certification, even through an 
alternative route, typically requires prospective 



"Certification and 
education requirements 
are a major reason young 
people decide to not 
become teachers- 55 
percent would be more 
likely to consider 
teaching in the absence 
of these barriers." 
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teachers to make significant investments of time 
and money in completing coursework 
requirements for teacher certification. Public 
Agenda found certification and education 
requirements are a major reason young people 
decide not to become teachers, and that 55 
percent would be"a lot" more likely to consider 
teaching in the absence of these barriers. 33 Since 
those with the most attractive non-teaching 
options are most likely be deterred by 
administrative impediments, high barriers likely 
lower teacher professional quality. If teacher 
training requirements have relatively high pass 
rates or are lacking in rigor, but are 
administratively burdensome, the net effect can 
lower teacher quality. That is what researchers 
JoshuaA ngrist and Jonathan G uryan found to be 
the case. Also, while teacher testing increased 
pay, they found it did not result in an increase in 
the proportion of teachers drawn from high- 
quality colleges, nor did it boost the fraction of 
teachers who taught in their field of specialty. 34 
Since education coursework requirements for 
certification are time consuming and expensive, 
but often lack rigor, they likely have a similar 
impact. 

W hile we would not necessarily urge 
states to abandon teacher certification 
altogether, we disagree with those who argue 
that more rigorous teacher certification 
requirements would improve the quality of 
the teaching profession. Policymakers must 
remember that teacher certification is not only 
a quality filter, but a barrier to entry into the 
teaching profession. 

Raising Pay Across the Board Is 
Expensive and Inefficient 

W hat about an across-the-board increase 
in teacher pay? Boosting all teachers' salaries 
would doubtless increase the number of 
applicants for each teaching job, but its impact 
on student outcomes would depend crucially 
on districts' ability to identify and hire the best 



"Raising average 
teacher salaries does 
not offer much 
promise for improving 
student performance." 



teachers from the available pool, and to 
encourage those teachers who are 
underperforming to find a different occupation. 

Analyzing the impact of average salaries on 
student performance in Texas, Eric Hanushek, 
John Kain, and Steven Rivkin found mixed 
evidence. 35 Although districts with higher 
salaries have teachers who perform better on 
the Professional 
D evelopment 
Test and the 
Elementary 
School Comp- 
rehensive Test, 
these scores are 
only weakly pre- 
dictive of how 

well teachers will perform in the classroom. They 
conclude that raising average salaries does not 
offer much promise for improving student 
performance, particularly given that much of the 
variation in teacher quality is within schools, 
rather than between them. 

Further, even if wholesale pay raises could 
also improve the quality of individuals 
entering teaching, raises not linked to job 
performance would not change the incentives 
for teacher excellence or satisfy the desire 
for greater professional and earnings growth 
opportunities throughout one's career, as 
found in other occupations. Nor could they 
change the distribution of teachers, and as a 
result could not correct for the significant 
inequities in teacher quality between poor 
and affluent school districts. Correcting these 
inequities requires targeted financial and other 
incentives to make high-poverty schools as 
attractive as affluent ones. 

Beyond this, raising average teacher pay 
would be prohibitively expensive, since it would 
mean a pay raise for both high performers and 
underperformers. A much better system would 
provide incentives for great teachers to stay, 
while encouraging underperformingteachersto 
leave the profession. 






WWW. PPIONLINE. ORG 



11 



Research Points to 
Promising Alternatives 



" A well-designed 
performance-based 
system of teacher pay 
serves students better 
than a simplistic 
seniority-based system." 



Performance-Based Pay 

Implementing a system of performance- 
based teacher pay, in which teachers are re- 
warded for better performance, is a highly 
promising approach to raising teacher quality. 
Evidence shows that a well-designed system 
of teacher pay serves students better than a 
simplistic seniority-based system. A good ex- 
ample of an effec- 
tive perfor- 
mance-based pay 
system was the 
scheme imple- 
mented in Ten- 
nessee from the 
mid-1980s until 
the mid-1990s. 

According to 
Thomas Dee and Benjamin Keys, it was success- 
ful in boosting student math scores. 36 More re- 
cently, schools in Denver, in cooperation with 
the local teacher unions, have adopted a merit- 
pay plan. And the M ilkenTeacher Advancement 
Program, based o n the principle that teacher pay 
should be driven by results, not seniority, is cur- 
rently operating in selected schools in eight 
states. 37 

Experimental evidence has shown that 
teacher performance-based pay can have a 
substantial benefit for students. In his analysis of 
an Israeli scheme that paid bonuses to teachers 
who most improved students' performance, 
Victor Lavy found that the program boosted 
matriculation rates by about 4 percentage points, 
at a cost of around $170 per student. He found 
no evidence that the bonus led teachers to 
manipulate students' test scores. Lavy also studied 
a scheme that used school-level bonuses and 
concluded that it too was effective in raising 
student performance, albeit at a somewhat 
higher cost. 38 



Teachers unions have traditionally 
opposed performance- based pay systems, but 
afew progressive unions— such as the Denver 
ClassroomTeachersAssociation— are leading 
the way with innovation in this field. In the 
past, many teachers have been skeptical of 
performance-based pay schemes because it 
relied entirely on test scores or put too much 
power into the hands of administrators. It is 
true that poorly designed performance-based 
pay programs can be arbitrary, unfair, or 
ineffective. But designing a smart performance- 
based pay system should be eminently 
achievable for policymakers throughout the 
nation. 

To be effective, the performance- based pay 
scheme should be structured so that the 
measures of teacher quality create the right 
set of incentives for teachers. Administrators 
should focus not at the levels of students' test 
scores, but on the change in scores from one 
year to the next year. Other measures of 
performance might include classroom 
observation by independent experts; 
interviews with the teacher; separate 
questionnaires from students, peers, and 
principals; and annual knowledge exams. 
Likewise, rewards for high performance 
should not be restricted to pay alone, and may 
also include increased professional 
responsibility, financial assistance for further 
study, and recognition by state government. 

Paying Teachers More to Work in 
Hard-to-Staff Schools 

W hile paying teachers based on their 
performance can provide greater incentives 
to attract talented individuals to the 
profession, performance-based pay in itself 
does not address the inequitable distribution 
of quality teachers. C reating a more equitable 
distribution of teachers requires higher 
salaries for teachers willing to work in hard- 
to -staff schools. 
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As we discuss above, labor market 
research shows that pay plays a role in where 
teachers decide to teach, but is only one of 
many factors. In particular, teachers seem to 
prefer to work in schools closer to home or 
the communities in which 
they were raised, and w here 
students are mo re similar to 
them racially and socio- 
economically. 

This combination of in- 
fluences suggests that offer- 
ing teachers more money to 
work in challenging com- 
munities can attract them to 
hard-to-staff schools, but also that the pay dif- 
ferentials between these and other commu- 
nities need to be substantial. For example, we 
noted above that N BCTs were over-concen- 
trated in affluent communities in every state 
except California. The explanation? Califor- 
nia offers a stipend of $20,000 paid out in 
$5,000 increments over four years, to N BCTs 
who choose to teach in high-poverty, low-per- 
forming schools. 39 

Alternative Certification 

More competitive teacher pay must also 
be accompanied by efforts to broaden the 
talent pool and raise the quality of potential 
teachers by reducing barriers to teaching. H igh 
numbers of applicants for expedited entry 
programs likeTeach for America, which draws 
applicants with strong academic recordsfrom 
top-tier schools and accepts only a small 
fraction of them, suggest that a substantial 
number of talented individuals are eager to 
teach if given an expedited route to enter the 
profession. 40 Teach for America and other 
alternative certification programs that 
streamline formal requirements take into 
account potential teachers' existing 
knowledge and skills, provide on-the-job 
training, and allow trainees to complete 



certification requirements while working as 
teachers.T his is one promising way to attract 
more highly capable individuals into teaching. 

How do teachers who follow an 
alternative route to certification fare in the 
classroom? Research shows 
that participants in pro- 
grams where teachers 
bypass some traditional 
licensure requirements 
have produced student 
results at least comparable 
to their traditionally 
prepared peers. 41 For ex- 
ample, a national study 
released this year by Mathematica Policy Re- 
search compared test score growth ofTeach 
for America teachers with test score growth 
of students taught by other teachers in the 
same school. For reading, there was no 
difference between Teach for America 
teachers and regular teachers. But in math, the 
scores ofTeach for America students were 
three percentage points higher— the 
equivalent of an extra month's worth of math 
instruction. 42 

These positive results suggest that we 
should look at ways of providing alternate 
routes to certification, such as Teach for 
America. Moreover, alternative routes to 
certification are more successful at drawing 
underrepresented groups— men and 
minorities, as well as individuals with strong 
content training in the sciences— into the 
teaching profession. 

Research-Based Policy 
Recommendations to 
Improve Teacher Quality 

Pay for Performance 

Experimental and observational research 
of programs that link teachers' pay to their 



“Alternative routes to 
certification are more 
successful at drawing 
underrepresented 
groups into the 
teaching profession." 
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students' achievement shows that such 
approaches can be effective at boosting 
teacher quality and student learning. 
Policymakers should work to make teacher 
pay more competitive and performance based, 
creating opportunities for teachers to earn 
higher salaries while also holding them 
financially accountable for outcomes. 

Based on research with merit pay and 
other competitive plans, policymakers 
considering linking teacher pay with student 
test scores should ensure the following: 

□ Teachers' salaries should not be based on 
the level of student test scores, but on 
student gains from one year to the next 
(i.e., the value added). 0 ne option is to 
use the same fixed-effects model outlined 
above in order to estimate the average 
value added by each teacher. K no w ing the 
value added, we can reward teachers 
directly for the gains that their students 
make, taking into account the innate 
aptitude of their student body. Estimating 
a fixed-effects model may sound complex, 
but in fact all the necessary information 
already resides in the computer databases 
of most state education departments. 

□ Performance-based pay should also take 
account of other measures of teacher 
performance, including classroom 
observation by an independent expert; an 
interview with the teacher; separate 
questionnaires from students, peers, and 
the principal; and perhaps even an annual 
knowledge exam. 

□ Higher salaries are not the only way to 
reward the most talented teachers. Pro- 
fessional recognition, greater responsibili- 
ties, and official acknowledgement by edu- 
cation officials are all important ways 
states and districts should encourage the 
best teachers to remain in the profession. 



UseTeacher Pay to Encourage 
More Equitable Distribution of 
Teachers 

Research on teacher labor markets and 
distribution suggests that higher, more 
competitive pay is essential to attract and keep 
high-quality teachers in the schools and positions 
that need them most. Teaching struggling 
students is hard work and thus requires not 
merely school finance equalization, but the 
resources for disadvantaged districts to pay 
teachers in hard-to-staff schools more than those 
in affluent schools. Just as in other occupations, 
those teachers who are working in 
disadvantaged schools that are hard to staff 
should be rewarded for their efforts. 
Policymakers offering salary differentials to 
recruit teachers for hard-to-staff schools should 
ensure the following: 

□ Salary differentials for teachers working 
in challenging situations must be 
substantial. Many teacher incentive 
programs offer only token bonuses or 
salary increases to teachers taking on 
additional or more difficult assignments. 
But research shows that the non-salary 
factors pushing quality teachers toward 
more affluent districts are many and 
powerful, requiring sizable financial 
incentives to work in needy schools to 
counter them. 

□ N ot all communities and schools have the 
same needs, and not all hard-to-staff 
schools look alike. Rather than 
establishing a one-size-fits-all policyto pay 
teachers more to work in schools with 
certain characteristics, policymakers 
should give states and school districts the 
flexibility to craft financial incentives that 
focus closely on attracting the right kinds 
of teachers to the schools and positions 
where they are most needed. 
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□ Simply adding incentives to an existing 
flawed budgeting system is not enough. 
District budgeting practices that charge 
schools the same rate per teacher, 
regardless of actual salary or skills, prevent 
poor schools from attracting high-quality 
teachers and result in lower per-pupil 
spending on poor students. By adopting 
student-based budgeting systems that 
ensure equitable per-pupil spending for all 
children, and moving more teacher hiring 
and pay authority to the school level, 
policymakers can give schools serving 
disadvantaged students the tools and 
resources they need to attract and 
competitively compensate high-quality 
teachers. 

Make Teacher Certification 
Smarter and More Streamlined 

Alternative certification is proving to be 
a promising way to attract qualified individuals 
to the teaching profession who would not 
otherwise become teachers. Alternative 
certification programs have been successful 
in attracting men, members of minority groups, 
graduates of competitive colleges, and 
individuals with backgrounds in sought-after 
subjects. W hile individual alternative 
certification programs vary considerably, 
research on high-quality programs, such as 
Teach for America, shows that their graduates 
are at least as effective, and in some cases more 
effective, than their conventionally certified 
peers. Policymakers should protect and 
encourage the expansion of alternative routes 
to teacher certification, particularly those 
specifically designed to attract teachers to 
disadvantaged schools. 

So far, there is little good research to 
suggest that traditional teacher certification 
really improves the quality of new recruits, as 
distinct from merely dissuading potential 
teachers. Equally troubling, research by D avid 



Steiner and Susan Rozen finds that the quality 
of curricula in schools of education is deeply 
flawed. Steiner and Rozen suggest that much 
of this coursework is of limited rigor, does 
not cover essential topics, and incorporates 
extraneous or ideologically biased material 
unrelated to teacher performance in the 
classroom. 43 In addition to promoting 
alternative routes to certification, state 
policymakers should reevaluate existing 
teacher licensure requirements to eliminate 
and consolidate bureaucratic barriers while 
also ensuring that prospective teachers cover 
truly essential content. 

Conclusion 

The NCLB requirements place a strong 
emphasis on using research-based approaches 
to improve student achievement. Yet, while 
educators work to base their work in 
research, policymakers continue to ignore 
research that shows that popular initiatives 
and strategies to boost teacher quality- 
reducing class sizes, raising teacher salaries 
across the board, and teacher certification- 
are ineffective or even counterproductive. 0 n 
the other hand, research has uncovered 
promising findings about the potential of 
teacher performance-based pay and 
alternative certification to raise teacher 
quality and outcomes for students in hard-to- 
staff schools. But policymakers are often still 
slow to implement these approaches because 
they challenge the status quo of public 
education and are thus controversial. 
Research has proven what steps must be 
taken by policymakers improve teacher 
quality. It is time for them to live up to the 
same standards they have set for educators 
and exercise the political will to put research- 
based teacher quality policies— performance- 
based pay, incentives to teach in hard-to-staff 
schools, and alternative certification routes— 
into action. 
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